HTTP BASED VIDEO STREAMING APPARATUS AND METHOD IN MOBILE 

COMMUNICATION SYSTEM 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

[1] The present invention relates to an Hypertext Transfer Protocol (HTTP) 
based video streaming apparatus and method, and particularly, to an HTTP-based video 
streaming apparatus and method that supports random access in a mobile communication 
system providing video streaming service based on HTTP. 

2. Background of the Related Art 

[2] Generally, video on demand (VOD) in a mobile communication system is a 
service that receives content information desired by a user from a server and plays the 
information on a mobile communication terminal. VOD can be realized in an HTTP -based 
download method and an RTP-based streaming method. 

[3] The HTTP-based download method plays the content information after 
downloading all of the content information in the terminal to provide high quality 
multimedia service. However, the HTTP based method requires that the user wait a period 
of time in order to completely download the contents. Moreover, the terminal requires a 
large amount of storage space for the fully downloaded content. 

[4] The Real Time Protocol (RTP) based streaming method, on the other hand, 
plays the received contents after buffering at least a portion of the contents for a 
predetermined initial delay time. The user is thus able to receive and view the contents in 
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real-time. However, the quality of the presentation of the content is limited due to the 
limitation in transmission bandwidth, and some of the data may be damaged due to the 
transmission environment. 

[5] An HTTP-based streaming method combines advantages of both the HTTP 
based download method and the RTP based streaming method. 

[6] Figure 1 is a drawing illustrating a related art HTTP based streaming apparatus. 
The apparatus includes a storing disk 10 for storing content files transmitted from a server 
(not shown), and a display unit 12 for displaying the content files stored in the storing disk 
10 by decoding them using a decoder 11 so that the user can view the contents. The 
apparatus further includes a random access searching unit 13 for searching a random access 
point requested by the user within the content files stored in the storing disk 10. 

[7] The random access searching unit 13 identifies whether there is a random 
access point required by the user in the content files stored in the storing disk 10, and 
decodes and plays from that point if the point is present in the content file. 

[8] The solid lines illustrated between the storing disk 10 and the decoder 11, 
between the decoder 11 and the display unit 12, and between the random access searching 
unit 13 and the storing disk 10 represent the signal flow for general HTTP streaming service, 
and the dotted lines represent a signal flow generated when random access is required by the 
user. 

[9] An operation of the related art HTTP-based streaming apparatus will be 
described as follows. First, transmission control protocol (TCP) packets, which are 
transmitted from a transmitting server, are stored in the storing disk 10 through a buffer by 
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the receiving party. The storing disk 10 stores the received packets for a predetermined 
period of time in file form. The files stored for the predetermined delay time are then 
decoded and played on the display unit 12 so that the user can view them. At that time, the 
storing disk 10 continuously receives and stores the packets from the transmitting party 
server while the stored files are displayed. 

[10] When the user requires random access, the random access searching unit 13 
searches the files stored in the storing disk 10 to determine whether the file stored in the 
storing disk 10 include the random access point. If the random access point is present in the 
file, the file is decoded and displayed on the display unit 12 from that point. On the contrary, 
if the required random access point is not in the files, the random access function is not 
supported. 

[11] The related art HTTP based streaming method has various problems. For 
example, as with the HTTP based download method in such viewpoints, port and data 
channel for transmitting the contents are set using HTTP, and TCP is used for transmitting 
the actual content packets. However, the HTTP based streaming method decodes and plays 
the received TCP packets after buffering them for a predetermined delay time, differently 
from the HTTP based download method in which the content files are played after 
transmitting the entire file from the server of the transmitting party to the receiving party. 

[12] Accordingly, the HTTP based streaming method has a disadvantage that the 
utility of the random access function is reduced to less than that of the RTP based streaming 
method. 
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[13] Additionally, the related art HTTP based streaming method is only able to 
perform the random access function for the content file stored in the storing disk after being 
transmitted to the receiving party. That is, in order to identify certain contents by the user, 
the certain content file must already be stored in the storing disk of the receiving party. 

[14] Therefore, according to the related art HTTP based streaming method, even if 
the user wants to receive information from a certain multimedia content point when the 
streaming has started, the transmission from that point cannot be made. 

[15] Also, according to the related art HTTP based streaming method, if the 
random access requirement occurs during the streaming service, the random access function 
for the above requirement cannot be supported if the corresponding contents are not stored 
in the storing disk of the receiving party. 

[16] The above references are incorporated by reference herein where appropriate 
for appropriate teachings of additional or alternative details, features and/or technical 
background. 

SUMMARY OF THE INVENTION 

[17] An object of the present invention is to solve at least the above problems 
and/ or disadvantages and to provide at least the advantages described hereinafter. 

[18] Another object of the present invention is to provide an HTTP based video 
streaming apparatus and method which can support a random access function as in an RTP 
based streaming method in a mobile terminal. 
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[19] Another object of the present invention is to provide an HTTP based video 
streaming apparatus and method which can support a random access function from a 
random access point required by a user even at an initial stage of streaming. 

[20] Another object of the present invention is to provide an HTTP based video 
streaming apparatus and method which can support a random access function even when a 
part required to be accessed randomly by the user has not been transmitted to memory. 

[21] To achieve at least these objects in whole or in parts, there is provided an 
HTTP based video streaming apparatus in a mobile communication system, including a 
storing disk for storing content files received from a server at a transmitting party, a random 
access searching unit for searching a random access point in the storing disk and 
transmitting a content file request message to the transmitting server if the random access 
point does not exist in the storing disk, and a display unit for playing the files from that 
random access point stored in the storing disk. 

[22] To further achieve at least the above objects, in whole or in parts, there is 
provided an HTTP based video streaming method in a mobile communication system, 
including a step of requiring content file when a random access point required by the user is 
not in the storing disk, a step of receiving data stream which is re-configured based on the 
random access point, and a step of playing the received content files. 

[23] To further achieve at least the above objects, in whole or in parts, there is 
provided an HTTP based video streaming method, including a step of receiving a random 
access requirement by a server on transmitting party from a random access searching unit, a 
step of searching the random access point in content files stored in the server, a step of re- 
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configuring data stream according to a screen type of the random access point, and a 
coincidence of the random access point and the data transmission starting point, and a step 
of transmitting the re-configured data stream. 

[24] To further achieve at least the above objects, in whole or in parts, there is 
provided an HTTP based video streaming method of a random access method of data 
stream including a plurality of headers having a plurality of media data samples and time 
information for the respective media data samples, including a step of searching an I-frame 
which is similar to the random access point required by the user, a step of configuring a 
media data sample as pointing the I-frame as data transmission starting point, and a step of 
changing header information of the media data sample. 

[25] To further achieve at least the above objects, in whole or in parts, there is 
provided an HTTP based video streaming method in a random access method of a data 
stream including a plurality of headers having a plurality of media data samples and time 
information for the media data samples, including a step of searching an I-frame which is 
most similar to the random access point required by the user, a step of converting a P-frame 
which is next to the I-frame into the I-frame through calculating, a step of configuring a 
media data sample as pointing the I-frame as data transmission starting point after 
converting the random access point, that is, the P-frame into the I-frame, and a step of 
changing header information of the media data sample. 

[26] Additional advantages, objects, and features of the invention will be set forth 
in part in the description which follows and in part will become apparent to those having 
ordinary skill in the art upon examination of the following or may be learned from practice 
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of the invention. The objects and advantages of the invention may be realized and attained 
as particularly pointed out in the appended claims. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[27] The invention will be described in detail with reference to the following 
drawings in which like reference numerals refer to like elements wherein: 

[28] Figure 1 is a diagram showing a configuration of an HTTP based streaming 
apparatus according to the related art; 

[29] Figure 2 is a diagram showing a configuration of an HTTP based video 
streaming apparatus in a mobile communication system according to a preferred 
embodiment of the present invention; 

[30] Figure 3 is a diagram showing a data stream configuration of a general MP4 

file; 

[31] Figure 4 is a diagram showing a data stream configuration of an MP4 file 
applied by file fragmentation process; 

[32] Figure 5 is a flow chart illustrating an HTTP based video streaming method in 
a mobile communication system according to a preferred embodiment of the present 
invention; 

[33] Figure 6 is a diagram showing a first embodiment of the present invention 
applied by the HTTP based video streaming method in a mobile communication system; and 



7 



f I 

[34] Figure 7 is a block diagram showing a second embodiment of the present 
invention applied by the HTTP based video streaming method in a mobile communication 
system. 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

[35] Reference will now be made in detail to the preferred embodiments of the 
present invention, examples of which are illustrated in the accompanying drawings. 

[36] According to a preferred embodiment of the HTTP based video streaming 
apparatus and method in a mobile communication system of the present invention, a 
random access function can be supported even in circumstances that cannot be supported 
by the related art HTTP based streaming method. For example, a random access function 
can be supported when the streaming has begun and when that data required by the random 
access has not yet been stored in memory. 

[37] Figure 2 is a drawing illustrating an HTTP based video streaming apparatus in 
a mobile communication system according to a preferred embodiment of the present 
invention. As shown therein, the HTTP based video streaming apparatus preferably 
includes a memory 21, such as a storage disk, for storing content files, or portions thereof, 
received from a transmitting server 20. It preferably further includes a random access 
searching unit 22 for searching the random access point required by a user in the content file 
stored in memory 21, and at the same time requesting the content file from the transmitting 
server 20 if the corresponding requested point does not exist in the stored content files. The 
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apparatus preferably further includes a decoder 23 for decoding the files from the random 
access point required by the user and a display unit 24 for displaying the decoded files. 

[38] The random access searching unit 22 supports the random access function so 
that the streaming can be begun from the random access point required by the user when 
the streaming has begun, and also transmits a content file request message to the 
transmitting server 20 if the random access point required by the user has not yet been 
stored in the memory 21. 

[39] In Figure 2, solid lines represent the signal flow for a general HTTP streaming 
service, and dotted lines represent the signal flow generated only when the random access is 
required by the user. 

[40] A configuration of the content file stored in the transmitting server 20 should 
preferably be changed for preferred embodiments of the HTTP based video streaming 
apparatus, so as to support the random access function when the random access is required 
after the streaming has begun but where the data required by the random access has not yet 
been stored in the memory 21. Specifically, the content file stored in the transmitting server 
20 is preferably an MP4 (MPEG-4) file. 

[41] Figure 3 is a drawing illustrating a configuration of a data stream for a general 
MP4 file. The MP4 file can preferably be divided into a header part and a media data part 
including audio and video data. 

[42] The header part includes information about audio and video areas as well as 
various other information, such as the timing information for the media data sample. 
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Therefore, when the content of the media data is temporally increased, a size of the header 
part is also proportionally increased. 

[43] In addition, in order to read the contents of the media data included in the 
MP4 file, the information included in the header part is required. Therefore, when the size of 
the header part is increased, the waiting time for watching the contents in the HTTP based 
streaming service is also increased. 

[44] In order to solve the above problem, the MP4 file format preferably includes 
an optional function, referred to as a file fragmentation, which divides one file into 
discontinuous plural segments. 

[45] Figure 4 is a drawing illustrating a data stream configuration of an MP4 file 
that has been modified by file fragmentation. The file preferably includes a plurality of media 
samples formed by dividing media data into N segments, and headers allocated to respective 
media data samples. 

[46] The headers preferably include a representative header (moov), having 
information corresponding commonly to the media data samples and timing information of 
the corresponding media data sample, and segment headers (moof) allocated to respective 
media data samples, except for the first media data sample, having time information of the 
corresponding media data sample. 

[47] The representative header is essential information since it includes the meta 
information of the MP4 file. Therefore, when the first media data sample is discarded and 
the next media data sample becomes the first media data sample, the segment header of the 
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next sample receives the information of the representative header and is converted into the 
representative header. 

[48] For example, as shown in Figure 4, when using the file fragmentation method, 
the size of the representative header is reduced by fragmenting one media data into several 
samples, and the segment header, which includes the time information for the divided media 
data sample, is additionally made. Moreover, when the file fragmentation method is used, it 
is easy to search the part corresponding to the random access request when the request is 
made. 

[49] The media data includes the video data. The video data preferably comprises 
either an I-frame, which includes entire screen information, or a P-frame, which only 
includes information for movement prediction. The P-frame has less data than the I-frame, 
and therefore the video data consists mosdy of P-frames. Additionally, the I-frame is 
located with a predetermined interval in order to prevent a defect from being generated on 
the video screen due to accumulating errors. 

[50] The HTTP based video streaming method in a mobile communication system 
according to the preferred embodiment of the present invention thus supports the random 
access function by using the file fragmentation method of the MP4 file stored in the 
transmitting server 20 and the I-frame disposed with a predetermined interval on the video 
bit stream. 

[51] Figure 5 is a flow chart illustrating the HTTP based video streaming method 
of the mobile communication system according to a preferred embodiment of the present 
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invention, and Figures 6 and 7 are block diagrams illustrating first and second embodiments 
applying the HTTP based video streaming method. 

[52] Referring to Figures 5, 6, and 7, the HTTP based video streaming method of 
the mobile communication system according to preferred embodiments of the present 
invention will be further described. 

[53] When a random access request is inputted by the user (step Sll), the random 
access searching unit 22 searches the content files stored in the memory 21 (step SI 2) to 
decide whether or not the requested random access point exists in the content files stored in 
the memory 21 (step SI 3). 

[54] If the random access point exists in the memory 21, the files are decoded from 
that point and are displayed so that the user can view it (step SI 4). 

[55] If, on the other hand, the random access point does not exist in the memory 
21, the random access searching unit 22 transmits a random access request message to the 
transmitting server 20, including information about the corresponding random access point. 

[56] The transmitting server 20 receives the random access request message, and 
searches for the random access point in the content files stored therein (step SI 5). The 
transmitting server 20 next determines whether or not the screen type of the searched 
random access point is an I-frame (step SI 6). At that time, the content files stored in the 
transmitting server 20 are preferably data stream configurations of the MP4 files applied by 
the file fragmentation process. 

[57] If it is determined that the type of the random access point is an I-frame, the 
media data sample including the corresponding I-frame is set (step SI 7). Then, the I-frame 
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is determined to be the data transmission starting point and the data stream corresponding 
to the user request is configured using the new media data sample including the I-frame and 
the next media samples (step SI 8). 

[58] Since the media data sample including the I-frame is the first packet 
transmitted by the random access request and the original representative header should be 
discarded, the segment header of the media data sample is converted into the representative 
header (step S19). At that time, the segment header is preferably converted into the new 
representative header by receiving information commonly corresponding to the respective 
media data samples from the original representative header. 

[59] The files are transmitted to the memory 21 of the receiving party starting from 
the random accessed point requested by the user (step S20). 

[60] When the type of the random access point is not the I-frame, the transmitting 
server 20 determines whether or not the user wants to receive the data from an exact 
random access point (step S21). If the user does not require the exact random access point, 
the transmitting server 20 detects an I-frame closest to the requested random access point 
(step S22), and then designates the media data sample including the I-frame (step SI 7). 

[61] The I-frame is thus set as the data transmission starting point and the data 
stream corresponding to the user request is configured using the new media data sample 
including the I-frame and the next media samples (step SI 8). Then, the segment header of 
the media data sample including the I-frame is converted into the representative header (step 
SI 9), and the data is transmitted to the memory 21 of the receiving party (step S20). 
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[62] If the type of the random access point is a P-frame, and if the data must be 
transmitted from the exact random access point, then the media data sample including the P- 
frame is found (step S23). The P-frame is then converted into an I-frame, and the new media 
data sample is configured based on the I-frame (step S24). 

[63] Specifically, the P-frame is converted into the I-frame using the fact that the 
general video bit stream comprises an I-frame (the reference frame) and a P-frame 
representing a difference from the I-frame or the previous frame. 

[64] Thus, in order to convert the P-frame into the I-frame, the 1-frame most 
similar to the P-frame is searched, and a value of the P-frame next to the I-frame is 
calculated with the I-frame to convert that P-frame into an I-frame. Then, the P-frame next 
to the newly converted I-frame is calculated with the converted I-frame to be converted into 
another new I-frame. 

[65] The above process is repeatedly performed until the P-frame corresponding to 
the random access point is reached, and the desired P-frame can therefore be converted into 
an I-frame. 

[66] Figure 6 illustrates a first embodiment of the present invention illustrating a 
method for configuring the data stream for the random access using the I-frame at the 
random access point requested by the user, or using the I-frame closest to the requested 
random access point. As shown therein, the I-frame is determined to be the data 
transmission starting point, and the segment header of the media data sample, including the 
I-frame, is converted into the representative header. 
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[67] Figure 7 illustrates a second embodiment of the present invention illustrating a 
method for configuring the data stream when the request random access point is a P-frame, 
and the exact random access point is required. As shown therein, the P-frame is converted 
into an I-frame and the converted I-frame is determined to be the data transmission starting 
point to configure the new data stream. 

[68] As described above, the preferred embodiments of the HTTP based video 
streaming apparatus and method of the mobile communication system has various 
advantages. For example, providing random access required by a user can be supported 
regardless of the environmental conditions and regardless of what is already in memory. 

[69] In addition, the random access service can be supported from the desired 
point when the user requires the streaming first, and the random access can be supported 
even when the part required by the user has not been stored in memory. 

[70] Also, various services can be provided according to the accuracy of the 
random access required by the user. For example, exact access to a P-frame can be provided. 

[7 1 ] The foregoing embodiments and advantages are merely exemplary and are not 
to be construed as limiting the present invention. The present teaching can be readily 
applied to other types of apparatuses. The description of the present invention is intended 
to be illustrative, and not to limit the scope of the claims. Many alternatives, modifications, 
and variations will be apparent to those skilled in the art. In the claims, means-plus-function 
clauses are intended to cover the structures described herein as performing the recited 
function and not only structural equivalents but also equivalent structures. 
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